Ch.4 Vector Spaces

Return to TOC

Vector Spaces

vector space over R\mathbb{R} consists of a set VV along with two operations '++' and '\cdot' with the condition that for all vectors v,w,uV\vec{v},\vec{w},\vec{u}\in V:

  1. set VV is closed under vector addition
  2. vector addition is commutativev+w=w+v\vec{v}+\vec{w}=\vec{w}+\vec{v}
  3. vector addition is associative(v+w)+u=v+(w+u)(\vec{v}+\vec{w})+\vec{u}=\vec{v}+(\vec{w}+\vec{u})
  4. there is a zero vector0V\vec{0}\in V such that v+0=v\vec{v}+\vec{0}=\vec{v} for all vV\vec{v}\in V
  5. each vV\vec{v}\in V has an additive inversewV\vec{w}\in V such that w+v=0\vec{w}+\vec{v}=\vec{0}
  6. the set VV is closed under scalar multiplication
  7. scalar multiplication distributes over addition of scalars(r+s)v=rv+sv(r+s)\cdot\vec{v}=r\cdot\vec{v}+s\cdot\vec{v}
  8. scalar multiplication distributes over vector additionr(v+w)=rv+rwr\cdot(\vec{v}+\vec{w})=r\cdot\vec{v}+r\cdot\vec{w}
  9. ordinary multiplication of scalars associates with scalar multiplication (rs)v=r(sv)(rs)\cdot\vec{v}=r\cdot(s\cdot\vec{v})
  10. multiplication by the scalar 1 is the identity operation 1v=v1\cdot\vec{v}=\vec{v}

Intuitively, its a space where linear combinations can happen

Example 4.1

Let VV be the line with slope 2 passing through the origin
V={t(12)|tR}V=\left\{t\begin{pmatrix}1\\2\end{pmatrix}\middle|t\in\mathbb{R}\right\}
It is very easy to check that given v1,v2,v3V\vec{v}_1,\vec{v}_2,\vec{v}_3\in V, all 10 conditions can be satisfied.

Example 4.2

P={(xyz)R3|2x+y+3z=0}P=\left\{\begin{pmatrix}x\\y\\z\end{pmatrix}\in\mathbb{R}^3\middle|2x+y+3z=0\right\}
Varify the two closure conditions, (1) and (6), because the others are similarly easily checked
Condition (1): sum of two vectors in the plane makes another vector in the plane
Let p1=(x1y1z1)\vec{p}_1=\begin{pmatrix}x_1\\y_1\\z_1\end{pmatrix} and p2=(x2y2z2)\vec{p}_2=\begin{pmatrix}x_2\\y_2\\z_2\end{pmatrix}.
The sum is p1+p2=(x1+x2y1+y2z1+z2)\vec{p}_1+\vec{p}_2=\begin{pmatrix}x_1+x_2\\y_1+y_2\\z_1+z_2\end{pmatrix}, which can be plugged in
For condition (6), show multiplying by a scalar yields a vector in the plane. Easy to check.

Example 4.3

The set of all nn-tall vectors (column vectors with nn components) is a vector space under natural operations.
All 10 conditions are easy to verify.

Example 4.4

Consider the set of quadratic polynomials P2{a0+a1x+a2x2|a0,a1,a2R}P_2\left\{a_0+a_1x+a_2x^2\middle|a_0,a_1,a_2\in\mathbb{R}\right\}
Adding two polynomials gives you another polynomial.
Multiplying by a scalar gives another polynomial, therefore these conditions are satisfied.
Since vector spaces can have linear combinations, you can take a linear combination of quadratic polynomials to get another quadratic polynomial

Example 4.5

The set Mm×nM_{m\times n} of all m×nm\times n matrices is a vector space with addition defined as follows:
For matrix A,BMm×nA,B\in M_{m\times n} and C=A+BC=A+B,
Ci,j=Ai,j+Bi,jC_{i,j}=A_{i,j}+B_{i,j}
and multiplication by a scalar with C=rAC=rA by
Ci,j=rAi,jC_{i,j}=rA_{i,j}
for i=1,...,mi=1,...,m and j=1,...,nj=1,...,n
Meaning linear combinations of m×nm\times n matrices yields another m×nm\times n matrix

The empty set cannot be a vector space becuase it does not have an additive identity.
However, V={(00)}V=\left\{\begin{pmatrix}0\\0\end{pmatrix}\right\} is a vector space, and is called the trivial vector space

Lemmas

For any vV\vec{v}\in V and rRr\in\mathbb{R},

  1. 0v=00\cdot\vec{v}=\vec{0}
  2. (1v)+v=0(-1\cdot\vec{v})+\vec{v}=\vec{0}
  3. r0=0r\cdot\vec{0}=\vec{0}
Proof of 1

v=(1+0)v=v+(0v)\vec{v}=(1+0)\cdot\vec{v}=\vec{v}+(0\cdot\vec{v})
Add additive inverse w\vec{w} such that v+w=0\vec{v}+\vec{w}=0
w+v=w+v+0v\vec{w}+\vec{v}=\vec{w}+\vec{v}+0\cdot\vec{v}
0=0+0v\vec{0}=\vec{0}+0\cdot\vec{v}
0=0v\vec{0}=0\cdot\vec{v}

Proof of 2

(1v)+(1v)=(1+1)v=0v=0(-1\cdot\vec{v})+(1\cdot\vec{v})=(-1+1)\cdot\vec{v}=0\cdot\vec{v}=\vec{0} by (1)

Proof of 3

r0=r(00)r\cdot\vec{0}=r\cdot(0\cdot\vec{0}) by (1), then
r(00)=(r0)0=00=0r\cdot(0\cdot\vec{0})=(r\cdot0)\cdot\vec{0}=0\cdot\vec{0}=\vec{0}


Subspace

For any vector space, a subspace is a subset that is itself a vector space, under the inherited operations
Essentially, a vector space within another vector space
Every vector space has a trivial subspace {0}\{\vec{0}\}
A subspace that is not the entire space is a proper subspace

y=2xy=2x is a subspace of the R2\mathbb{R}^2 vector space

For a nonempty subset SS of a vector space, under the inherited operations the following are equivalent statements

  1. SS is a subspace of the vector space
  2. SS is closed under linear combinations of pairs of vectors
  3. SS is closed under linear combinations of any number of vectors
    (i.e. if one is true all are true)

A subset is a subspace iff it is closed under linear combinations (that is the only condition to check)

Proof

Strategy: prove (1)(3)(2)(1)(1)\implies(3)\implies(2)\implies(1)
(1)(3)(1)\implies(3) is obvious because SS is a vector space
(3)(2)(3)\implies(2) is obvious because "any number" can mean 2
all that remains is to prove (2)(1)(2)\implies(1)
Assume SVS\subset V for a vector space VV (SS is nonempty) and that SS is closed under linear combinations of pairs of vectors.
If SS is closed under a linear combination of a pair of vectors, then for s1,s2Ss_1,s_2\in S, s1+s2Ss_1+s_2\in S.
For commutativity, for s1,s2Ss_1,s_2\in S, s1+s2Ss_1+s_2\in S is equal to s1+s2Vs_1+s_2\in V, which is equal to s2+s1Vs_2+s_1\in V since VV is a vector space, and this is in turn equal to s2+s1Ss_2+s_1\in S.
Associativity is similar.
For the zero vector, the linear combination of 0s1+0s2=0S0\cdot s_1+0\cdot s_2=\vec{0}\in S, which can be shown to be the zero vector in a similar way.
For additive inverse, since 0S\vec{0}\in S, the linear combination 00+(1)s0\cdot\vec{0}+(-1)\cdot\vec{s} is in SS, and is clearly the additive inverse.
The multiplication conditions are similar.

Example 4.6

The vector space P2={a0+a1x+a2x2a0,a1,a2R}\mathcal{P}_2=\{a_0+a_1x+a_2x^2|a_0,a_1,a_2\in\mathbb{R}\} has a subspace of linear polynomials L={b0+b1xb0,b1R}L=\{b_0+b_1x|b_0,b_1\in\mathbb{R}\}
To prove, we only need to show it is closed under a linear combination of two members.
r(b0+b1x)+s(c0+c1x)=(rb0+sc0)+(rb1+sc1)xLr\cdot(b_0+b_1x)+s\cdot(c_0+c_1x)=(rb_0+sc_0)+(rb_1+sc_1)x\in L
Note that this only works because we assumed P2\mathcal{P}_2 is a vector space.
If that isn't given, you must prove P2\mathcal{P}_2 is a vector space.

Example 4.7

Subset of R3\mathbb{R}^3 is a plane
P={(xyz)|2xy+z=0}P=\left\{\begin{pmatrix}x\\y\\z\end{pmatrix}\middle|2x-y+z=0\right\}
Since R3\mathbb{R}^3 is clearly a vector space, to show this is a subspace we only need to prove it is closed under linear combinations
Take two vectors (x1y1z1),(x2y2z2)P\begin{pmatrix}x_1\\y_1\\z_1\end{pmatrix},\begin{pmatrix}x_2\\y_2\\z_2\end{pmatrix}\in P
They satisfy
2x1y1+z2=02x2y2+z2=02x_1-y_1+z_2=0\\2x_2-y_2+z_2=0
The vector sum is (x1+x2y1+y2z1+z2)\begin{pmatrix}x_1+x_2\\y_1+y_2\\z_1+z_2\end{pmatrix}, which must also satisfy the condition
2(x1+x2)(y1+y2)+(z1+z2)=2x1y1+z2+2x2y2+z2=0+0=02(x_1+x_2)-(y_1+y_2)+(z_1+z_2)=2x_1-y_1+z_2+2x_2-y_2+z_2=0+0=0
so PP is closed under addition.
Next take (xyz)P\begin{pmatrix}x\\y\\z\end{pmatrix}\in P and rRr\in \mathbb{R}
Consider the condition on the scalar product (rxryrz)\begin{pmatrix}rx\\ry\\rz\end{pmatrix}:
2rxry+rz=r(2xy+z)=r0=02rx-ry+rz=r(2x-y+z)=r\cdot0=0
so PP is closed under scalar multiplication
Therefore, PP is a subspace of R3\mathbb{R}^3

Example 4.8

Consider this subset of R3\mathbb{R}^3:
P={(xyz)|2xy+z=1}P=\left\{\begin{pmatrix}x\\y\\z\end{pmatrix}\middle|2x-y+z=1\right\}
Note that this is the identical to the subset in Example 4.7 except it equals 11 instead of 00.
Under vector addition of (x1y1z1),(x2y2z2)P\begin{pmatrix}x_1\\y_1\\z_1\end{pmatrix},\begin{pmatrix}x_2\\y_2\\z_2\end{pmatrix}\in P
the vector sum (x1+x2y1+y2z2+z2)\begin{pmatrix}x_1+x_2\\y_1+y_2\\z_2+z_2\end{pmatrix} does not satisfy the condition:
2(x1+x2)(y1+y2)+(z1+z2)=2x1y1+z1+2x2y2+z2=1+1=22(x_1+x_2)-(y_1+y_2)+(z_1+z_2)=2x_1-y_1+z_1+2x_2-y_2+z_2=1+1=2
A similar thing occurs in scalar multiplication, where it no longer equals 11, so these are not closed under addition or scalar multiplication, so PP is not a subspace (it is still a subset)